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I I j.  'A  R5TPAC  T 


Past  research  has  demonstrated  the  value  of  the  Brief  Vestibular  Disorientation  Test  (BVDT)  as  a 
screening  tool  for  student  pilots.  This  study  is  concerned  with  the  extension  of  this  technique  for 
use  in  assessing  the  potential  Naval  Flight  Officer  (NFO). 

The  rater  BVDT  procedure  was  used  here,  and  in  addition,  a performance  task  involving  a short- 
term memory  task  in  the  auditory  mode  was  introduced  in  order  to  measure  performance  decrement. 
Representative  groups  of  entering  NFO  students  were  first  administered  the  performance  task  under 
the  exact  conditions  of  the  previous  BVDT  procedure,  but  without  rotation.  After  a 2-minute  rest 
period,  the  procedure  was  repeated  with  rotation . Observer  assessments  were  made  during  this 
rotation  sequence.  The  results  indicate  that  those  students  who  later  failed  NFO  training  exhibited 
greater  performance  decrement  under  rotary  conditions  as  compared  to  static  than  did  successful 
students.  Rater-type  BVDT  scores  abo  indicated  slightly  greater  sensitivity  (.07  level  of  signifi- 
cance) to  the  vestibular  stimulus  for  the  failures  than  for  the  successes.  It  was  concluded  that  this 
technique  is  of  value  in  screening  NFO's. 
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SUMMARY  PAGE 


THE  PROBLEM 

Past  research  has  demonstrated  the  value  of  the  Brief  Vestibular  Disorientation 
Test  (BVDT)  as  a screening  tool  for  student  pilots  (1).  This  study  is  concerned  with  tho 
extension  of  this  technique  for  use  in  assessing  the  potential  Naval  Flight  Officer 
(NFO). 

FINDINGS 

The  rater  BVDT  procedure  was  used  here,  and  in  addition,  a performance  task 
involving  a short-term  memory  task  in  the  auditory  mode  was  introduced  in  order  to 
measure  performance  decrement.  Representative  groups  of  entering  NFO  students  were 
first  administered  the  performance  task  under  the  exact  conditions  of  the  previous 
BVDT  procedure,  but  without  rotation.  After  a two-minute  rest  period,  the  procedure 
was  repeated  with  rotation.  Observer  assessments  were  made  during  this  rotation 
sequence.  The  results  indicate  that  those  students  who  later  failed  NFO  training 
exhibited  greater  performance  decrement  under  rotary  conditions  as  compared  to  static 
than  did  successful  students.  Rater-type  BVDT  scores  also  indicated  slightly  greater 
sensitivity  (.07  level  of  significance)  to  the  vestibular  stimulus  for  the  failures  than  for 
the  successes.  It  was  concluded  that  this  technique  is  of  value  in  screening  NFO's. 


RECOMMENDATIONS 

It  is  recommended  that  the  performance  test  portions  of  the  procedure  be  cross- 
validated  for  both  student  NFO's  and  pilots. 
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INTRODUCTION 

A Brief  Vestibular  Disorientation  Test  (BVDT)  has  been  developed  that  involves 
observer,  or  rater,  assessments  of  subjects1  reactions  elicited  by  subject-controlled 
head  tilt  during  slow,  whole-body  rotation  around  an  Earth-vertical  axis.  It  has  been 
reported  that  pooled  judgments  by  three  or  more  raters  on  pallor,  sweating,  facial 
expression,  steadiness,  recovery  rate,  and  over-all  reaction  have  been  found  to  be 
statistically  reliable  measures  and  to  be  predictive  of  later  success  or  failure  in  pilot 
training.  Similar  degrees  of  successful  predictions  have  been  reported  by  others  (10, 
11).  It  has  also  been  demonstrated  that  the  BVDT  score  significantly  augmented  the 
multiple  correlation  of  existing  aviation  selection  variables  with  the  same  criterion 
(1).  This  report  is  concerned  wi'n  the  extension  of  this  technique  for  use  in  assessing 
the  potential  Naval  Flight  Officer  (NFO)  or  nonpilot  airborne  technical  specialist, 
who  must  perform  complex  tasl.s  in  a motion  environment  over  which  he  has  no  control. 


PROCEDURE 


Test  persons  were  116  entering  NFO  students.  Although  the  rater  BVDT  pro- 
cedure as  previously  described  was  used  here  (1-3,8),  emphasis  was  on  a performance 
task  involving  short-term  memory  in  the  auditory  mode.  This  was  introduced  in  order 
to  measure  performance  decrement.  The  rationale  for  Interposing  performance  decre- 
ment measurement  rather  than  simply  replicating  the  exact  procedures  used  for  the 
pilot  samples  was  based  on  experience  with  these  pi! rt  samples.  It  was  evident  that 
among  individuals  who  were  disturbed  by  disorientation  stress,  some  were  able  to 
function  in  the  flight-learning  situation  and  others  were  not.  The  rater  BVDT  undoubt- 
edly attained  its  validity  from  this  latter  group,  and  the  former  group  probably  lowered 
prediction  coefficients.  It  was  reasoned,  therefore,  that  the  sensitive  individual  who 
could  continue  to  perform  a mental  task  during  the  BVDT  stimulus  might  also  override 
his  sensitivity  in  the  aircraft  situation  and  perform  according  to  standards.  Thus,  it 
was  considered  possible  that  the  superposition  of  performance  tasks  on  the  BVDT  pro- 
cedure might  improve  predictive  power. 

In  developing  the  task  used  here,  certain  requirements  were  considered;  1)  Since 
all  previous  BVDT  data  were  obtained  under  eyes-closed  conditions,  any  task  involving 
the  visual  mode  was  not  considered.  2)  Brevity  is  necessary  so  it  was  important  to  have 
a task  that  would  produce  many  data  point'  in  a short  period  of  time.  3)  The  response 
mode  and  method  of  recording  must  be  reasonably  simple.  The  task  developed  was  a 
variation  of  a procedure  suggested  by  Williams  and  reported  in  a review  by  Gaiambos 
(5).  Specifically,  the  task  required  the  test  person  to  monitor  a series  of  random  digits 
presented  orally  at  the  rate  of  two  per  second,  and  each  time  a zero  was  presented,  to 
recall  the  two  digits  immediately  preceding  the  zero,  sum  them,  and  report  the  sum 
orally.  The  task  had  eight  data  points,  or  zeros,  per  30  seconds.  At  the  30-second 
points,  a head  movement  was  made  according  to  a single  word  instruction  by  a voice 
different  from  the  one  producing  the  digit  series.  A zero  never  occurred  during  the 
head  movement.  The  actual  test  consisted  of  a static  run  through  the  digits  with  the 
examinee  seated  in  a motorized  rotary  chair  with  eyes  closed.  Head  movement 
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instructions  were  given  at  30*second  intervals  or  at  precisely  the  same  points  as  the 
rater  BVDT.  After  a 2-minute  rest  period  the  identical  sequence  was  repeated  with 
constant  rotation  speed  of  15  rpm  begun  at  time  zero  and  stopped  at  5 minutes  and  30 
seconds.  The  examinee  was  required  to  respond  to  the  digits  for  30  seconds  after  cessa- 
tion of  rotation.  The  digit  series  and  all  instructions  were  taped.  A transcript  of  the 
taped  instructions  is  contained  in  Appendix  A.  The  examiner  recorded  the  examinee's 
oral  responses  by  marking  o specially  designed  score  sheet,  which  is  included  as 
Appendix  B.  All  responses  were  retrievable  data.  Rights,  wrongs,  and  omissions  were 
immediately  available  for  each  of  the  segments  within  a run  and  for  the  total  run.  Dur- 
ing this  rotation  sequence,  three  observers  made  independent  ratings  of  each  examinee. 
Rater  estimates  of  pal  lor,  sweating,  facial  expression,  unsteadiness,  speed  of  recovery, 
and  over-all  performance  were  recorded  on  a ten-point  scale.  Appendix  C contains  this 
rating  sheet.  The  low  point  on  the  scale  represented  low  sensitivity,  or  no  effect.  An 
individual  rater's  score  was  obtained  by  summing  his  judgments  on  the  six  factors.  The 
rater  BVDT  score  for  a given  student  was  the  mean  of  these  three  individual  ratings. 
Finally,  each  student  was  asked  to  complete  a self-rate  sheet  regarding  his  own  reactions 
to  the  "ride"  or  the  rotary  sequence.  This  rate-sheet  is  presented  in  Appendix  D. 

This  over-all  procedure,  titled  BVD-2P,  produced  four  types  of  data: 

1)  Observer  {udgments  or  ratings 

2)  Subjective  or  self-ratings 

3)  Objective  performance  measures 

4)  Performance  decrement  as  expressed  by  difference  between  static 
and  rotary  performance  measures. 

The  116  students  experienced  this  BVD-2P  procedure  during  their  first  or  indoc- 
trination week  of  Aviation  Officer  Candidate  School.  Approximately  eight  months  after 
the  last  student  was  tested  the  training  progress  of  the  sample  was  determined  according 
to  a dichotomous  criterion,  satisfactory  progress  versus  student  separation,  which  was 
used  in  assessing  the  four  types  of  test  measures. 

ANALYSIS  AND  RESULTS 


OBSERVER  JUDGMENTS 

Table  I presents  a comparison  between  the  means  of  the  rater  BVDT  scores  for 
the  separations  and  non-separations. 

These  values  indicate  slightly  greater  sensitivity  for  the  reparations  than  for  the 
non-separations,  but  the  differences  were  of  only  borderline  significance.  This  finding 
was  not  unexpected  since  concentration  on  a task  during  vestibular  stimulation  previous- 
ly has  been  found  to  reduce  physical  symptoms  (4,  p.  306;  7,  p.  385).  Table  II  corrob- 
orates this  point.  The  mean  rater  BVDT  scores  obtained  under  the  performance  conditions 
described  hnre  tended  to  be  lower  than  those  obtained  earlier  under  the  non-performance 
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conditions.*  Any  evaluation  of  the  rater  technique  per  se,  therefore,  should  be  apart 
from  performance  tasks. 

Table  I 

Comparison  of  Rater  BVOT  Scores  between  Separations  and  Non-separations 
Obtained  under  Performance  Test  (BVD-2P)  Conditions 


Separations 

Non-separations  r pt.  bis. 

•m 

X 

13.88 

11.21  .169  <.07 

s.d. 

9.51 

4.40 

N 

24 

92 

Table  II 

Comparison  of  Rater  BVDT  Scores  between  Rater  Only  and 
Performance  Versions  of  the  Test 

Rater  Only  Condition** 

Performance  Test  Condition 

X 

13.46 

11.81 

S.d 

6.13 

5.94 

N 

465 

116 

t = 2.61 

<.01 

*The  decreased  reacivity  with  the  cognitive  task  in  the  present  study  is  inferentially 
supportive  of  the  notion  (cf.  Lacey  et  al.,9)  that  such  tasks  increase  heart  rate,  dimin- 
ish transmission  along  sensory  pathways,  and  decrease  the  effectiveness  of  externa! 
stimuli,  although  this  idea  will  have  to  be  reconciled  with  the  well-established  fact 
that  mental  arithmetic  increases  vestibular  nystagmus. 


**From  two  previously  reported  samples  which  also  were  exposed  to  13  rpm  '!)» 
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SELF-RATINGS 

The  mean  comparisons  for  the  self-ratings  show  no  significant  differences  between 
the  students  who  separated  and  those  who  have  not  separated  (Table  III).  This  is  con- 
trary to  some  previous  results  on  student  pilot  samples;  however,  no  data  comparisons 
are  appropriate  here  because  the  self-rate  form  used  in  this  study  was  different  from 
the  previous  one.  Additionally/  it  is  noted  that  although  the  students  were  instructed 
to  respond  to  the  effects  of  the  "ride/1  some  of  them  volunteered  that  they  were  also 
influenced  by  how  favorably  they  perceived  their  own  performance  on  the  task  in  both 
the  static  and  rotary  modes.  In  this  experimental  format,  therefore,  the  self-rating  sum- 
mary scores  are  judged  to  be  of  little  'value. 

Table  III 

Comparison  of  Post  Rotary  Self-ratings  between  Separations  and  Non-separations 
Obtained  under  Performance  Test  (BVD-2P)  Conditions 


Separations 

Non-separations 

r pt.  bis. 

mm 

X 

32.38 

30.24 

s.d. 

13.11 

10.70 

.077 

N 

24 

92 

OBJECTIVE  PERFORMANCE  MEASURES 

Table  IV  contains  comparisons  between  the  separations  and  non-separations  for 
six  sets  of  mean  scores  derived  from  the  auditory  performance  task.  The  intercorrela- 
tions among  these  six  scores,  the  above  mentioned  Rater  BVDT  score,  the  Self-Rate,  and 
the  criterion,  are  contained  in  Table  V.,  The  six  performance  scores  examined  were  the 
number  of  correct  responses,  errors,  and  omissions  for  the  entire  time  course  under  both 
static  and  rotary  conditions.  As  seen  from  the  point  biserial  correlation  values,  the 
strongest  relationships  with  the  dichotomous  criterion  of  separation  versus  non-separa- 
tion were  obtained  for  the  correct  and  omitted  responses,  and  for  these  two  the  relation- 
ships in  the  rotary  mode  were  stronger  than  in  the  static  mode.  The  error  score  showed 
no  discrimination  in  either  mode. 

The  strength  of  the  validity  coefficients  of  the  performance  task  in  the  static 
mode  is  a serendipitous  finding  that  must  be  considered  in  evaluating  the  performance 
during  rotation.  The  partial  correlation  technique  was  applied  to  determine  the  value 
of  the  rotary  validity  coefficients  with  the  static  validity  held  constant  or  partialed  out. 
The  Rotary  Corrects  Score  correlation  of  .233  thus  was  reduced  to  .167,  and  the  Rotary 
Omissions  Score  correlation  of  - .255  was  reduced  to  - .190.  This  value  indicates  that 
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some  significant  validity  remained  for  the  performance  task  in  the  rotary  mode.  With 
respect  to  the  significance  of  the  correlation  in  the  static  mode,  the  possibility  should 
not  be  overlooked  that  the  threat  of  the  imminent  rotation  experience,  especially  in 
individuals  who  are  exceptionally  apprehensive  about  unusual  motion,  could  have  con- 
tributed to  this  significant  difference  as  well  as  the  actual  nature  of  the  task.  This 
question  should  be  investigated  further. 


Table  IV 


Comparison  of  Six  Performance  Task  Indices  from  BVD-2P 
between  Separations  and  Non-separations 


Separations 

Non-separations 

r pt.  bis.* 

Static  Correct 

X 

51.96 

57.53 

s.d. 

15.48 

12.67 

.168 

Static  Errors 

X 

14.13 

13.42 

s.d. 

10.14 

7.03 

-.037 

Static  Omissions 

X 

30.63 

25.07 

s # d # 

16.15 

11.42 

i 

vj 

VJ 

Rotary  Correct 

mm 

X 

50.58 

59.73 

s.d. 

16.39 

14.82 

.233 

Rotary  Errors 

X 

10.08 

10.03 

s.d. 

8.73 

6.19 

.003 

Rotary  Omissions 

X 

35.50 

25.79 

s.d. 

17.42 

13.90 

-.255 

*Two-tailed  significance  values:  .10  = .155; 

.05  = .184;  .01  = .242. 
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PERFORMANCE  DFCREMENT 


The  next  level  of  analysis  concerned  an  examination  of  performance  decrement 
or  the  differences  between  the  static  and  rotary  modes  on  the  performance  task. 

Figure  1 shows  the  time  course  curves  of  the  cumulative  mean  differences  between 
the  static  and  rotary  conditions  for  the  number  of  omitted  responses  on  the  performance 
task.  The  broken  line  represents  the  data  for  separating  students,  and  the  solid  line 
represents  non-separating  students.  The  F ratio  between  the  two  groups  was  significant 
at  less  than  the  5 percent  level . An  examination  of  the  two  curves  shows  that  the  non- 
separations tended  to  improve  over  their  static  performance  during  the  first  half  of  the 
rotation  procedure  while  the  separations  tended  to  deteriorate.  The  later  portions  of 
both  curves  are  similar.  In  other  words,  both  groups  displayed  decrement  of  response 
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Table  V 

Intercorrelation  Matrix  of  Test  Variables  and  Criterion* 


4 

# 
• $ 
% 


Variables 

1 

2 3 

4 5 6 7 

8 9 

1)  Rater  BVDT 

1.000 

.422  -.135 

.201  .017  -.339  -.055 

.357  -.181 

2)  Self-Rato 

1,000  -.280 

.079  . 257  -.368  -.033 

.379  -.077 

3)  Static  Correct 

1.000 

-.398  -.827  .795  -.213 

-.745  .168 

4)  Static  Errors 

1.000  -.181  -.357  .755 

,023  -.037 

5)  Static  Omission 

1.000  -.631  -.233 

.781  -.177 

6)  Rotary  Correct 

1.000  -.271 

-.881  .233 

7)  Rotary  Errors 

1.000 

-.177  .003 

8)  Rotary  Omissions 

1.000  -.255 

9)  Separations  vs 

Non- 

1.000 

separations 

‘'Two-tailed  significance  values:  .10  = .155;  .05  = .184;  .01  = .242. 


production  under  rotary  conditions  as  compared  to  static,  buf  the  separation  group  dis- 
played the  decrement  much  earlier  in  the  time  course  than  the  non-separation.  Similar 
curves  (Figure  2)  were  obtained  for  the  cumulative  mean  differences  of  correct  responses, 
but  the  F ratio  was  significant  only  within  the  10  percent  level. 

DISCUSSION  AND  CONCLUSIONS 

The  BVD  stimulus  is  one  which  produces  a conf  Actual  sensory  message  from  the 
inner  ear  by  virtue  of  a cross-coupled  Coriolis  stimulus  to  the  semicircular  canals  in 
one  plane,  while  the  otolith  organs  signal  change  in  orientation  in  another  plane.  For 
a given  head  movement,  the  magnitude  of  the  stimulus  is  directly  related  to  angular 
velocity  of  the  rotating  device  (6). 

The  evidence  indicates  that  the  BVD  stimulus  procedure,  combined  with  the 
performance  task  approach,  will  be  productive  for  screening  nonpilot  aircrew  personnel. 
Additional  data  have  been  collected  and  are  in  the  process  of  maturation.  These  will 
permit  an  attempt  to  replicate  the  key  findings  of  this  report  and,  if  appropriate,  will 
also  prescribe  standards  to  be  used  in  conjunction  with  other  predictors.  Meanwhile, 
explorations  of  other  performance  tasks  in  the  visual  mode  are  underway. 
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INSTRUCTIONS  FOR  BVD-2P 

There  are  two  parts  to  this  experiment.  During  the  first  part  you  are  requested 
to  sit  in  a comfortable  upright  position  in  the  chair,  to  keep  your  eyes  closed,  to  make 
certain  head  movements,  and  to  monitor  a series  of  numbers.  Part  I will  last  exactly 
6 minutes.  At  the  first  30-second  point  you  will  hear  a female  voice  say  the  word, 

"right."  As  soon  as  you  hear  this  instruction,  move  your  head  laterally  to  your  right 
shoulder.  Move  it  slowly  to  about  a 45  tilt.  Take  about  3 seconds  to  complete  the 
movement.  You  are  to  keep  your  head  in  this  position  for  30  seconds.  You  will  then 
hear  the  instruction,  "center."  Return  your  head  to  the  upright  position  slowly.  Take 
about  3 seconds  for  each  movement.  A lateral  movement  means  that  the  head  is  tilted 
to  the  side,  not  rotated  around  the  vertical  axis  of  the  body.  One  way  to  assure  a 
lateral  movement  is  to  keep  the  nose  pointed  straight  ahead  at  all  times.  At  the  1-min- 
ute  and  30-second  point  you  will  hear  the  instruction,  "left."  Move  your  head  to  the 
left  in  the  same  manner  as  before.  Thirty  seconds  later  you  will  hear,  "center,"  again. 

At  4 additional  30-second  intervals,  you  will  receive  a head  movement  instruction  in 
this  manner.  At  4-minutes  and  30-seconds  the  instruction  will  be  the  word,  "forward." 
This  means  that  you  are  to  move  your  head  forward  about  45  . At  time  5 minutes  you 
will  hear  the  word,  "center,"  again.  You  will  then  return  to  the  upright  position.  You 
are  to  remain  seated  in  an  upright  position  with  eyes  closed  during  the  last  60  seconds. 
(Pause.)  Are  there  any  questions?  (Pause  on  tape  and  prepare  to  stop  tape  if  questioned.) 

The  monitoring  task  requires  that  you  listen  to  a continuing  series  of  numbers. 

Each  time  you  hear  zero,  you  are  to  give  the  sum  of  the  two  numbers  immediately  pre- 
ceding that  zero.  For  example,  you  may  hear  5,  9,  7,  2,  1,  3,  0.  As  soon  as  you 
hear  the  zero  you  should  try  to  recall  the  3 and  the  1 , add  them,  and  report  the  number 
4 in  a clear,  audible  voice.  You  must  respond  quickly  as  the  number  series  is  continu- 
ing, and  you  must  respond  each  time  you  hear  zero.  You  must  listen  for  the  head  move- 
ment instructions  and  perform  the  head  movement  while  monitoring  and  responding  to  the 
numbers.  To  minimize  confusion,  the  number  series  is  given  in  a male  voice.  The  head 
movement  instructions  at  30-second  intervals  are  givsn  in  a female  voice.  Here  is 
another  example  of  the  number  series  exactly  as  you  will  hear  it  during  the  experiment. 
This  time  you  will  hear  the  superimposed  head  movement  instruction.  For  this  example, 
the  head  movement  instructions  are  closer  than  30  seconds  apart.  Give  the  sum  of  the 
two  numbers  preceding  each  zero.  Answer  as  quickly  as  you  can  in  a clear,  audible 
voice  and  move  your  head  when  directed.  Ready.  4,  1,6,  3,  4,  0,  9,  2,  5,  4,  0,  4, 

9,  1,  (right)  0,  4,  4,  6,  7,  2, 1,  0,  5,  3,  2,  (center)  5,  6,  1,  9,  8,  0.  (Pause.)  Are 
there  any  questions?  (Pause  on  tape  and  prepare  to  stop  tape  it  questioned.) 


Stand  by  to  begin  Part  I . Ready.  Close  your  eyes.  Begin.  (Number  series 
starts  here.)  End  of  Part  I.  You  may  open  your  eyes  and  relax  for  a moment.  (Stop 
tape.)  (Rest  2 minutes.) 

Part  II  is  identical  to  Part  I except  that  the  chair  will  rotate  slowly.  The  chair 
will  stop  rotating  approximately  30  seconds  after  you  have  returned  to  center  from  the 
head  forward  position.  However,  you  should  keep  your  eyes  closed  and  continue 
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responding  to  the  number  erios  until  directed  to  stop.  (Pause.)  Are  there  an/  questions? 
(Pause  on  tape  and  prepare  ro  stop  tape  if  questioned.) 


Stand  by  to  begin  Part  II.  Ready.  Close  your  eyas.  Begin  rotation.  (Number 
series  starts  here.)  End  of  Part  II.  You  may  open  your  eyes.  Thanks  for  your  coopera- 
tion. 
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Rater's  Name  Date 


APPENDIX  D 
Self-Rate  Sheet  (Rev.) 


NAME  DATE 


Check  the  following  items  at  the  appropriate  point  o-« 
affected  you: 

1 

wording  to  how  this  ride 

Li"l<e 

2 

Dislike 

No  stomach  effects 
3 

Strong  effects 

No  dizziness 
4 

Strong  dizziness 

No  sickness  feelings 
5 

Strong  feelings 

Steady 

6 

Very  unsteady 

Hot  No  change 

7 

Cold 

Dry 

8 

Wet 

Readiness  for  physical  test 
9 

Non-readinesss 

i Readiness  for  aptitude  test 

1 10 

Non-readiness 

| Not  wonted 

| Rate  your  reactions  while  accelerating  and  rotating, 

1 11 

Worried 

| No  reaction 

| Rate  your  reactions  while  decelerating  and  stopping. 

| 12 

Strong  reaction 

No  reaction 

Strong  reaction 
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